Data Flow Control Within and Between DMA Channels

ABSTRACT

In one embodiment, a direct memory access (DMA) controller comprises a transmit circuit and a data flow control circuit coupled to the transmit circuit. The transmit circuit is configured to perform DMA transfers, each DMA transfer described by a DMA descriptor stored in a data structure in memory. There is a data structure for each DMA channel that is in use. The data flow control circuit is configured to control the transmit circuit&#39;s processing of DMA descriptors for each DMA channel responsive to data flow control data in the DMA descriptors in the corresponding data structure.

BACKGROUND

1. Field of the Invention

This invention is related to the field of direct memory access (DMA)controllers in computer systems.

2. Description of the Related Art

In a typical system that includes one or more processors, memory, andinput/output (I/O) devices or interfaces, direct memory access (DMA)transfers are often used to transfer data between the I/O and thememory. In some systems, individual DMA circuitry is included in eachI/O device or interface that uses DMA. In other systems, one or more I/Odevices may share DMA circuitry.

Often, data is DMA transferred to memory to be processed by theprocessors, or data is created by the processors for DMA transferred toI/O. For example, packet data from a network interface, such astransport control protocol/internet protocol (TCP/IP) packets, are oftenreceived and processed. The processed packets may also be transmittedagain, and the processors may also generate packets for transmission.

The “load” of processing the DMA data may be fairly large, and mayimpact the ability of the processors to execute other processing tasks.Some of the DMA processing may be fairly regular and well-defined. Forexample, packets may be encrypted and/or authenticated. Accordingly,received packets may have to be unencrypted by the processor and/or mayhave to be authenticated before other processing of the packets.Similarly, packets prepared for transmission may have to be encryptedand/or have authentication information (such as a hash of the packetdata) generated. To the extent that the processing of DMA data presentsan excessive load to the processor, performance in the system can benegatively impacted.

In some cases, hardware acceleration of some or all of the above taskscan be performed. In such cases, the data must generally be DMAtransferred to the hardware accelerator, and the result data must be DMAtransferred back to memory. A relatively complex task can involvemultiple DMA transfers to and from various hardware accelerators. Toensure proper operation, a mechanism to control data flow between DMAtransfers is needed.

SUMMARY

In one embodiment, a direct memory access (DMA) controller comprises atransmit circuit and a data flow control circuit coupled to the transmitcircuit. The transmit circuit is configured to perform DMA transfers,each DMA transfer described by a DMA descriptor stored in a datastructure in memory. There is a data structure for each DMA channel thatis in use. The data flow control circuit is configured to control thetransmit circuit's processing of DMA descriptors for each DMA channelresponsive to data flow control data in the DMA descriptors in thecorresponding data structure. A corresponding method is alsocontemplated.

In another embodiment, an apparatus comprises a host comprising a memorysystem; and a direct memory access (DMA) controller coupled to the host.The DMA controller is configured to perform DMA transfers, each DMAtransfer described by a DMA descriptor stored in a data structure in thememory system. There is a data structure for each DMA channel that is inuse, and the DMA controller is configured to control the processing ofDMA descriptors for each DMA channel responsive to data flow controldata in the DMA descriptors in the corresponding data structure.

BRIEF DESCRIPTION OF THE DRAWINGS

The following detailed description makes reference to the accompanyingdrawings, which are now briefly described.

FIG. 1 is a block diagram of one embodiment of a system.

FIG. 2 is a block diagram of one embodiment of a DMA controller shown inFIG. 1.

FIG. 3 is a block diagram of one embodiment of an offload engine shownin FIG. 2.

FIG. 4 is a block diagram of one embodiment of descriptor rings andbuffer pointer rings.

FIG. 5 is a flowchart illustrating prefetch operation of one embodimentof a transmit control circuit shown in FIG. 2.

FIG. 6 is a flowchart illustrating data flow control of one embodimentof a transmit control circuit shown in FIG. 2.

FIG. 7 is a block diagram illustrating one embodiment of a transmit DMAdescriptor.

FIG. 8 is a block diagram illustrating one embodiment of a controldescriptor.

FIG. 9 is a block diagram illustrating one embodiment of a copy DMAdescriptor.

FIG. 10 is a block diagram of one embodiment of an offload DMAdescriptor.

FIG. 11 is a block diagram of one embodiment of TCP/IP processing usingthe control descriptors.

While the invention is susceptible to various modifications andalternative forms, specific embodiments thereof are shown by way ofexample in the drawings and will herein be described in detail. Itshould be understood, however, that the drawings and detaileddescription thereto are not intended to limit the invention to theparticular form disclosed, but on the contrary, the intention is tocover all modifications, equivalents and alternatives falling within thespirit and scope of the present invention as defined by the appendedclaims.

DETAILED DESCRIPTION OF EMBODIMENTS

Turning now to FIG. 1, a block diagram of one embodiment of a system 10is shown. In the illustrated embodiment, the system 10 includes a host12, a DMA controller 14, interface circuits 16, and a physical interfacelayer (PHY) 36. The DMA controller 14 is coupled to the host 12 and theinterface circuits 16. The interface circuits 16 are further coupled tothe physical interface layer 36. In the illustrated embodiment, the host12 includes one or more processors such as processors 18A-18B, one ormore memory controllers such as memory controllers 20A-20B, an I/Obridge (IOB) 22, an I/O memory (IOM) 24, an I/O cache (IOC) 26, a level2 (L2) cache 28, and an interconnect 30. The processors 18A-18B, memorycontrollers 20A-20B, IOB 22, and L2 cache 28 are coupled to theinterconnect 30. The IOB 22 is further coupled to the IOC 26 and the IOM24. The DMA controller 14 is also coupled to the IOB 22 and the IOM 24.In the illustrated embodiment, the interface circuits 16 include aperipheral interface controller 32 and one or more media access controlcircuits (MACs) such as MACs 34A-34B. The MACs 34A-34B are coupled tothe DMA controller 14 and to the physical interface layer 36. Theperipheral interface controller 32 is also coupled to the I/O bridge 22and the I/O memory 34 (and thus indirectly coupled to the DMA controller14) and to the physical interface layer 36. The peripheral interfacecontroller 32 and the MACs 34A-34C each include configuration registers38A-38C. In some embodiments, the components of the system 10 may beintegrated onto a single integrated circuit as a system on a chip. Inother embodiments, the system 10 may be implemented as two or moreintegrated circuits.

The host 12 may comprise one or more address spaces. At least a portionof an address space in the host 12 may be mapped to memory locations inthe host 12. That is, the host 12 may comprise a memory system mapped toaddresses in the host address space. For example, the memory controllers20A-20B may each be coupled to memory (not shown) comprising the memorylocations mapped in the address space. In some cases, the entirety ofthe address space may be mapped to the memory locations. In other cases,some of the address space may be memory-mapped I/O (e.g. the peripheralinterface controlled by the peripheral interface controller 32 mayinclude some memory-mapped I/O).

The DMA controller 14 is configured to perform DMA transfers between theinterface circuits 16 and the host address space. Particularly, the DMAtransfers may be between memory locations to which the address space ismapped and the interface circuits 16. Additionally, the DMA controller14 may, in some embodiments, be configured to perform DMA transfersbetween sets of memory locations within the address space. That is, boththe source and destination of such a DMA transfer may be memorylocations. The functionality of a data mover may thus be incorporatedinto the DMA controller 14, and a separate data mover may not berequired, in some embodiments. The programming model for thememory-to-memory DMA transfers may be similar to the programming modelfor other DMA transfers (e.g. DMA descriptors, described in more detailbelow). A memory-to-memory DMA transfer may also be referred to as acopy DMA transfer.

The DMA controller 14 may be configured to perform one or moreoperations (or “functions”) on the DMA data as the DMA data is beingtransferred, in some embodiments. The operations may be performed ontransfers between the address space and the interface circuits, and mayalso be performed on copy DMA transfers, in some embodiments. Operationsperformed by the DMA controller 14 may reduce the processing load on theprocessors 18A-18B, in some embodiments, since the processors need notperform the operations that the DMA controller 14 performs. In oneembodiment, some of the operations that the DMA controller 14 performsare operations on packet data (e.g. encryption/decryption, cyclicalredundancy check (CRC) generation or checking, checksum generation orchecking, etc.). The operations may also include an exclusive OR (XOR)operation, which may be used for redundant array of inexpensive disks(RAID) processing, for example.

The DMA controller 14 may support various DMA channels for DMAtransfers. Each channel may be an independent logical data path from asource to a destination. A complex task for the DMA controller functions(or other hardware accelerators, in some embodiments) may be dividedacross channels, or may be multiple DMA transfers within a singlechannel, or some combination of both. However, since the DMA transfersare part of a larger task, the transfers may actually have dependencieson each other. For example, one transfer may provide input data that isused by another transfer (e.g. a transfer may involve a function orother result generation that is used by the other transfer).Alternatively, DMA transfers may have an ordering dependency as part ofthe larger overall task. In order to provide for such dependencies whilepermitting the larger task to be established by software and then run tocompletion (assuming no errors in the task), the DMA controller 14 maysupport data flow control data in the DMA channels. In the absence ofdata flow control data, the DMA controller 14 may be free to process DMAchannels in parallel and to process descriptors within a channel inparallel (or overlapped in processing). When data flow control is neededto perform the set of DMA transfers properly to accomplish an overalltask, the data flow control data may be included in the DMA channels.Generally, data flow control data may be any data that causes DMAtransfers to be performed in a certain order that would not beguaranteed in the typical operation of the DMA controller for thechannels.

One set of data flow control data, for one embodiment, may includecontrol descriptors that update flags in a set of flags implemented bythe DMA controller 14 and control descriptors that wait on a given valuein the flags. A source DMA channel may include one or more DMAdescriptors to perform DMA transfers, followed by a control descriptorto update the flags. A target channel may include a control descriptorthat waits on the update to the flags, and then one or more DMAtransfers that are dependent on the DMA transfer(s) in the sourcechannel. Any number of DMA channels may be data flow controlled in thisfashion. Multiple channels may be flow controlled for a source channelby including control descriptors in those channels to wait on the sameflag (updated by the source channel). Thus, a broadcast model from thesource channel to several target channels may be supported. Similarly,multiple source dependencies may be handled in a target DMA channel byincluding multiple control descriptors waiting on the flags updated byeach of those source channels.

While the above description refers to one flag update per controldescriptor, other embodiments may permit multiple flag updates in onecontrol descriptor, as desired. Similarly, while the above descriptionrefers to a control descriptor that waits on a value in one flag, otherembodiments may support waiting on values of multiple flags, if desired.

In another embodiment, dependent DMA transfers may be included in thesame DMA channel. While DMA transfers in the same channel may generallybe attempted in the order listed, there is nothing that preventsparallel processing of DMA transfers (e.g. prefetching DMA descriptorsand/or data for the next transfer while a current transfer is beingperformed, or even performing transfers to different targetsconcurrently, in some embodiments). To avoid such parallelprocessing/prefetching for cases where a dependency exists, data flowcontrol data may be included in the DMA descriptors themselves. Forexample, an embodiment of the DMA descriptors may include a serializeindication to indicate whether or not the DMA transfer specified by agiven descriptor should be serialized with subsequent descriptors. TheDMA controller may inhibit any parallel processing/prefetching if theserialize indication indicates serialization.

In some embodiments, both the serialize indication and the flags may beimplemented. In such cases, for example, the serialize indication mayindicate serialize in the DMA descriptor prior to the control descriptorthat updates the flags. Alternatively, the DMA controller 14 mayautomatically serialize control descriptors that update the flags withpreceding DMA descriptors.

In general, DMA transfers may be transfers of data from a source to adestination, where at least one of the destinations is a memory locationor other address(es) in the host address space. The DMA transfers areaccomplished without the transferred data passing through theprocessor(s) in the system (e.g. the processors 18A-18B). The DMAcontroller 14 may accomplish DMA transfers by reading the source andwriting the destination. For example, a DMA transfer from memory to aninterface circuit 16 may be accomplished by the DMA controller 14generating memory read requests (to the IOB 22, in the illustratedembodiment, which performs coherent read transactions on theinterconnect 30 to read the data) and transmitting the read data as DMAdata to the interface circuit 16. In one embodiment, the DMA controller14 may generate read requests to read data into the IOM 24 for a DMAtransfer through the peripheral interface controller 32, and theperipheral interface controller 32 may read the data from the IOM 24 andtransmit the data. A DMA transfer from an interface circuit 16 to memorymay be accomplished by the DMA controller 14 receiving data from theinterface circuit 16 and generating memory write requests (to the IOB22, in the illustrated embodiment) to transfer the DMA data to memory.In one embodiment, the peripheral interface controller 32 may write datato the IOM 24, and the DMA controller 14 may cause the data to bewritten to memory. Thus, the DMA controller 14 may provide DMA assistfor the peripheral interface controller 32. Copy DMA transfers may beaccomplished by generating memory read requests to the source memorylocations and memory write requests to the destination memory locations(including the DMA data from the memory read requests).

The host 12 may generally comprise one or more processors and memorycontrollers configured to interface to memory mapped into the host 12'saddress space. The host 12 may optionally include other circuitry, suchas the L2 cache 28, to enhance the performance of the processors in thehost 12. Furthermore, the host 12 may include circuitry to interface tovarious I/O circuits and the DMA controller 14. While one implementationof the host 12 is illustrated in FIG. 1, other embodiments may includeany construction and interface to the DMA controller 14 and interfacecircuits 16.

The processors 18A-18B comprise circuitry to execute instructionsdefined in an instruction set architecture implemented by the processors18A-18B. Any instruction set architecture may be implemented in variousembodiments. For example, the PowerPC™ instruction set architecture maybe implemented. Other exemplary instruction set architectures mayinclude the ARM™ instruction set, the MIPS™ instruction set, the SPARC™instruction set, the x86 instruction set (also referred to as IA-32),the IA-64 instruction set, etc.

The memory controllers 20A-20B comprise circuitry configured tointerface to memory. For example, the memory controllers 20A-20B may beconfigured to interface to dynamic random access memory (DRAM) such assynchronous DRAM (SDRAM), double data rate (DDR) SDRAM, DDR2 SDRAM,Rambus DRAM (RDRAM), etc. The memory controllers 20A-20B may receiveread and write transactions for the memory to which they are coupledfrom the interconnect 30, and may perform the read/write operations tothe memory. The read and write transactions may include read and writetransactions initiated by the IOB 22 on behalf of the DMA controller 14and/or the peripheral interface controller 32. Additionally, the readand write transactions may include transactions generated by theprocessors 18A-18B and/or the L2 cache 28.

The L2 cache 28 may comprise a cache memory configured to cache copiesof data corresponding to various memory locations in the memories towhich the memory controllers 20A-20B are coupled, for low latency accessby the processors 18A-18B and/or other agents on the interconnect 30.The L2 cache 28 may comprise any capacity and configuration (e.g. directmapped, set associative, etc.).

The IOB 22 comprises circuitry configured to communicate transactions onthe interconnect 30 on behalf of the DMA controller 14 and theperipheral interface controller 32. The interconnect 30 may supportcache coherency, and the IOB 22 may participate in the coherency andensure coherency of transactions initiated by the IOB 22. In theillustrated embodiment, the IOB 22 employs the IOC 26 to cache recenttransactions initiated by the IOB 22. The IOC 26 may have any capacityand configuration, in various embodiments, and may be coherent. The IOC26 may be used, e.g., to cache blocks of data which are only partiallyupdated due to reads/writes generated by the DMA controller 14 and theperipheral interface controller 32. Using the IOC 26, read-modify-writesequences may be avoided on the interconnect 30, in some cases.Additionally, transactions on the interconnect 30 may be avoided for acache hit in the IOC 26 for a read/write generated by the DMA controller14 or the peripheral interface controller 32 if the IOC 26 hassufficient ownership of the cache block to complete the read/write.Other embodiments may not include the IOC 26.

The IOM 24 may be used as a staging buffer for data being transferredbetween the IOB 22 and the peripheral interface 32 or the DMA controller14. Thus, the data path between the IOB 22 and the DMA controller14/peripheral interface controller 32 may be through the IOM 24. Thecontrol path (including read/write requests, addresses in the hostaddress space associated with the requests, etc.) may be between the IOB22 and the DMA controller 14/peripheral interface controller 32directly. The IOM 24 may not be included in other embodiments.

The interconnect 30 may comprise any communication medium forcommunicating among the processors 18A-18B, the memory controllers20A-20B, the L2 cache 28, and the IOB 22. For example, the interconnect30 may be a bus with coherency support. The interconnect 30 mayalternatively be a point-to-point interconnect between the above agents,a packet-based interconnect, or any other interconnect. The interconnectmay be coherent, and the protocol for supporting coherency may varydepending on the interconnect type.

The interface circuits 16 generally comprise circuits configured tocommunicate on an interface to the system 10 according to any interfaceprotocol, and to communicate with other components in the system 10 toreceive communications to be transmitted on the interface or to providecommunications received from the interface. The interface circuits maybe configured to convert communications sourced in the system 10 to theinterface protocol, and to convert communications received from theinterface for transmission in the system 10. For example, interfacecircuits 16 may comprise circuits configured to communicate according toa peripheral interface protocol (e.g. the peripheral interfacecontroller 32). As another example, interface circuits 16 may comprisecircuits configured to communicate according to a network interfaceprotocol (e.g. the MACs 34A-34B).

The MACs 34A-34B may comprise circuitry implementing the media accesscontroller functionality defined for network interfaces. For example,one or more of the MACs 34A-34B may implement the Gigabit Ethernetstandard. One or more of the MACs 34A-34B may implement the 10 GigabitEthernet Attachment Unit Interface (XAUI) standard. Other embodimentsmay implement other Ethernet standards, such as the 10 Megabit or 100Megabit standards, or any other network standard. In one implementation,there are 6 MACs, 4 of which are Gigabit Ethernet MACs and 2 of whichare XAUI MACs. Other embodiments may have more or fewer MACs, and anymix of MAC types.

Among other things, the MACs 34A-34B that implement Ethernet standardsmay strip off the inter-frame gap (IFG), the preamble, and the start offrame delimiter (SFD) from received packets and may provide theremaining packet data to the DMA controller 14 for DMA to memory. TheMACs 34A-34D may be configured to insert the IFG, preamble, and SFD forpackets received from the DMA controller 14 as a transmit DMA transfer,and may transmit the packets to the PHY 36 for transmission.

The peripheral interface controller 32 comprises circuitry configured tocontrol a peripheral interface. In one embodiment, the peripheralinterface controller 32 may control a peripheral component interconnect(PCI) Express interface. Other embodiments may implement otherperipheral interfaces (e.g. PCI, PCI-X, universal serial bus (USB),etc.) in addition to or instead of the PCI Express interface.

The PHY 36 may generally comprise the circuitry configured to physicallycommunicate on the external interfaces to the system 10 under thecontrol of the interface circuits 16. In one particular embodiment, thePHY 36 may comprise a set of serializer/deserializer (SERDES) circuitsthat may be configured for use as PCI Express lanes or as Ethernetconnections. The PHY 36 may include the circuitry that performs 8b/10bencoding/decoding for transmission through the SERDES andsynchronization first-in, first-out (FIFO) buffers, and also thecircuitry that logically configures the SERDES links for use as PCIExpress or Ethernet communication links. In one implementation, the PHYmay comprise 24 SERDES that can be configured as PCI Express lanes orEthernet connections. Any desired number of SERDES may be configured asPCI Express and any desired number may be configured as Ethernetconnections.

It is noted that, in various embodiments, the system 10 may include oneor any number of any of the elements shown in FIG. 1 (e.g. processors,memory controllers, caches, I/O bridges, DMA controllers, and/orinterface circuits, etc.).

Turning now to FIG. 2, a block diagram of one embodiment of the DMAcontroller 14 is shown. For the embodiment of FIG. 2, a descriptorsoftware model for causing DMA transfers will be discussed. In someembodiments, a register-based software model may be supported inaddition to or instead of the descriptor model. In a register-basedmodel, each DMA transfer may be programmed into the DMA controller 14,and the DMA controller 14 may perform the DMA transfer. At completion ofthe transfer, the DMA controller 14 may either interrupt one of theprocessors 18A-18B or provide status (e.g. in a register within the DMAcontroller 14) that software may poll to determine when the DMA transferhas completed.

In the descriptor model, software may establish multiple DMA transfersto be performed using descriptor data structures in memory. Generally, aDMA descriptor may comprise a data structure in memory that describes aDMA transfer. The information in the DMA descriptor, for example, mayspecify the source and target of the DMA transfer, the size of thetransfer, and various attributes of the transfer. In some cases, thesource or target of the DMA transfer may be implicit. Multipledescriptors may be stored in a descriptor data structure in memory (e.g.in a “descriptor ring”), and the DMA controller 14 may be programmedwith the address of the first descriptor in the data structure. The DMAcontroller 14 may read the descriptors and perform the indicated DMAtransfers. A variety of control mechanisms may be used to controlownership of descriptors between software and hardware. For example, thedescriptors may include valid bits or enable bits which indicate to theDMA controller 14 that the DMA transfer described in the descriptor isready to be performed. An interrupt bit in a descriptor may be used toindicate that the DMA controller 14 is to interrupt the processor18A-18B at the end of a given DMA transfer, or an end-of-transfer bitmay be used to indicate that the descriptor describes the last DMAtransfer and the DMA controller 14 should pause. Alternatively, the DMAcontroller 14 may implement descriptor count registers that may beincremented by software to indicate how many descriptors are availablefor the DMA controller 14 to process. The DMA controller 14 maydecrement a descriptor count register to indicate that a prefetch of adescriptor has been generated. In other embodiments, the DMA controller14 may decrement the descriptor count register to indicate consumptionof a descriptor (i.e. performance of the specified DMA transfer). Instill other embodiments, the DMA controller 14 may use a separatedescriptor processed count register to indicate how many descriptorshave been processed or prefetched.

The DMA controller 14 may perform transmit (Tx) DMA transfers andreceive (Rx) DMA transfers. Tx DMA transfers have an address space inthe host 12 as a source (e.g. memory locations in the memory coupled tothe memory controllers 20A-20B). Rx DMA transfers have an address spacein the host 12 as a target. Tx DMA transfers may have an interfacecircuit 16 as a target, or may have another address in the host 12address space as a target (e.g. for copy DMA transfers). Tx DMAtransfers that have host address space targets may use the Rx DMA datapath to write the DMA data read from the source address to the targetaddress.

In the illustrated embodiment, the DMA controller 14 comprises a Txcontrol circuit 56 on the Tx DMA data path, and an Rx control circuit 58on the Rx DMA data path. The Tx control circuit 56 may prefetch datafrom the host 12 for transmit DMA transfers. Particularly, the Txcontrol circuit 56 may prefetch DMA descriptors, and may process the DMAdescriptors to determine the source address for the DMA data. The Txcontrol circuit 56 may then prefetch the DMA data. While the termprefetch is used to refer to operation of the Tx control circuit 56, theprefetches may generally be read operations generated to read thedescriptor and DMA data from the host address space.

As mentioned above, the DMA controller 14 may support various DMAchannels Specifically, DMA channels may be supported for transmit DMAtransfers and receive DMA transfers. Any number of channels may besupported, in various embodiments. For example, in one implementation,20 transmit DMA channels may be provided and 64 receive DMA channels maybe provided.

The channels may be assigned as desired by software. More particularly,each transmit channel may assigned to one of the interface circuits 16or one of the loopback component circuits 42, 44, or 46 (described inmore detail below). Not all transmit channels need be in use (that is,some transmit channels may be disabled). The Tx control circuit 56 mayprefetch DMA descriptors and DMA data on a per-channel basis. That is,the Tx control circuit 56 may independently generate prefetches for eachchannel that has DMA descriptors available for processing. The Txcontrol circuit 56 may select among the generated prefetches to transmitread requests to the IOM/IOB interface unit 70.

Each receive channel may be assigned to one of the interface circuits16. Not all receive channels need be in use (that is, some receivechannels may be disabled). The Rx control circuit 58 may receive thechannel number with received data. The loopback circuit 40 may supply abuffer pointer from the DMA descriptor for the DMA, and the Rx controlcircuit 58 may use the buffer pointer to write the DMA data to the hostaddress space. The interface circuits 16 may be programmable with theassigned channels, or may employ packet filtering to determine achannel. The interface circuits 16 may supply the channel number withthe DMA data, and the Rx control circuit 58 may use a buffer pointerprovided from the Rx prefetch engine 60 for the channel to write the DMAdata to the host address space. The Rx prefetch engine 60 may prefetchthe buffer pointers from data structures in memory.

A data flow control circuit 70 is coupled to the Tx control circuit 56and the Rx control circuit 58. In the illustrated embodiment, the dataflow control circuit 70 includes a flags register 72. In otherembodiments, there may be more than one flags register 72. The flagsregister 72 stores a set of flags that may be used to provide data flowcontrol between DMA channels (and more particularly between transmit DMAchannels). The data flow control circuit 70 may maintain the flags inthe flags register 72 and may interface to the Tx control circuit 56 toperform the control descriptors that wait on values in the flags andwhich update the flags values. In one embodiment, the data flow controlcircuit 70 may also participate in the serialization of DMA transfers inthe same channel as well. For example, if the Tx control circuit 56encounters a control descriptor that waits on a value of a flag, the Txcontrol circuit 56 may provide an indication of the DMA channel, theflag, and the value being waited on to the data flow control circuit 70and may stall processing for the DMA channel that included thedescriptor. Similarly, if the Tx control circuit 56 detects a DMAdescriptor that indicates serialization, the Tx control circuit 56 maygenerate the operations to perform the DMA transfer, may communicate theserialization request and the DMA channel number of the DMA channel thatis serialized, and may stall processing for that DMA channel. In eithercase, when the Rx control circuit 58 indicates done for the channel, thedata flow control circuit 70 may release the Tx control circuit 56 toprocess on that channel. Stalling of processing by the Tx controlcircuit 56 may include inhibiting any prefetching or parallel processingDMA transfers in the corresponding channel, and may further includeinhibiting prefetching of DMA descriptors from the channel.

The Rx control circuit 58 may provide a done indication the data flowcontrol circuit 70 to indicate that a DMA transfer to memory iscomplete. In one embodiment, the done indication may include a channelnumber indicating which DMA channel has a DMA transfer completing, andmay also include a valid signal that may be asserted to indicate that aDMA transfer is being indicated as completed. Generally, the Rx controlcircuit 58 may indicate that the DMA transfer is complete, via the doneindication, when the write operations that store the DMA data to memoryare globally visible. A write operation may be viewed as globallyvisible if any read operation to the same memory location as the writeand performed subsequent to the point at which the write becomesglobally visible will return the data written by the write operation(until the write data is itself overwritten). The DMA data may also bereferred to as globally visible if the DMA data is returned in responseto a read of the memory locations to which the data was stored. Forexample, in one embodiment, a write operation is globally visible onceit has been coherently ordered on the coherent interconnect to thememory system. In a bus based system, a successful transfer of theaddress phase on the bus may make a write globally visible.

The flags register 72 may store the flags described above with regard toFIG. 1. The Tx control circuit 56, in response to a control descriptorthat updates on the flags, communicates the update to the data flowcontrol circuit 70. The data flow control circuit 70 may modify theidentified flag or flags. Similarly, in response to a control descriptorthat waits on a value of a flag, the Tx control circuit 56 maycommunicate the wait to the data flow control circuit 70. The data flowcontrol circuit 70 may release the Tx control circuit 56 for the channelin which the wait was detected when the value indicated by the controldescriptor is found in the flags register 72.

In one embodiment, the flags register 72 is software accessible. Thatis, instructions executing on the processors 18A-18B may read and/orwrite the contents of the flags register 72. Software may thusinitialize flags in the register 72, and may also determine the contentsof the flags register 72. Software accessibility may also aid in errorhandling. If a source DMA transfer ends in an error, the controldescriptor that updates the flag that is being waited on may not occur.This could leave a channel hung waiting on the flag value. If errorhandling software detects that an update to a flag is being waited on,it may update the flag to release the hung channel.

In one embodiment, each flag is a bit having a set and clear state.Updates to either the set or clear state may be performed using controldescriptors, and either the set or clear state may be waited on by acontrol descriptor. In other embodiments, one state may be the initialvalue and the other state may be the value to which the controldescriptor updates the flag. For example, the clear state may be theinitial value and the set state may be the updated value, or vice versa.In still other embodiments, a flag may be a multibit value and any valueof the flag may be specified to be waited on. Any number of flags may besupported.

A loopback circuit 40 may provide the link between the Tx DMA data pathand the Rx DMA data path. That is, a “loopback circuit” comprisescircuitry local to the DMA controller that is coupled to receive Tx DMAdata from a transmit DMA data path and to provide Rx DMA data on areceive DMA data path. The data provided by the loopback circuit 40 onthe receive DMA data path may be the data received from the transmit DMAdata path (e.g. for the copy DMA function). In some embodiments, thedata provided by the loopback circuit 40 may be data transformed by theloopback circuit 40 from the received data. In some embodiments, thedata provided by the loopback circuit 40 may be the data received by theloopback circuit 40, augmented by a result calculated by the loopbackcircuit 40 on the data (e.g. checksum, CRC data, etc.). Alternatively,the data provided by the loopback circuit 40 may be the data received bythe loopback circuit 40 (or the data may not be provided), and theresult may be stored in the descriptor for the DMA transfer. Either thetransformed data or the result calculated and included with the data orwritten to the DMA descriptor may generically be referred to herein asthe “result”.

Thus, in some embodiments, the loopback circuit 40 may be configured toperform one or more operations (or “functions”) on the Tx DMA data toproduce a result (e.g. transformed DMA data, or a result generated fromthe data). In the embodiment of FIG. 2, the loopback circuit 40 mayinclude a copy FIFO 42, an offload engine 44, and an exclusive OR (XOR)circuit 46 coupled to the transmit data path. The copy FIFO 42 may storetransmit data from the Tx DMA data path for transmission on the Rx DMAdata path. Accordingly, the copy FIFO 42 may perform the copy DMAoperation. The offload engine 44 may be configured to perform variousoperations on the DMA data, producing either transformed data or aresult separate from the data. The offload engine 44 may be configuredto provide any desired set of operations, in various embodiments. In oneembodiment, the offload engine 44 may be configured to performoperations that aid in packet processing. For example, various networksecurity protocols have been developed that provide for encryptionand/or authentication of packets. Authentication typically includesgenerating a hash over some or all of the packet. So, the offload engine44 may be configured to perform encryption/decryption and/or hashfunctions on packet data in a DMA transfer. Additionally, the offloadengine 44 may be configured to perform checksum generation/checkingand/or CRC generation/checking. Checksum and/or CRC protection are usedin various packet protocols. The XOR circuit 46 may bitwise-XOR DMA data(e.g. DMA data from multiple sources). The XOR circuit 46 may be used,e.g., to support redundant arrays of inexpensive disks (RAID) processingand other types or processing that use XOR functions.

The loopback circuit 40 (and more particularly, the loopback components42, 44, and 46) may operate on the DMA data during the DMA transfer thatprovides the DMA data to the loopback circuit 40. That is, the loopbackcircuit 40 may at least start performing the operation on the DMA datawhile the Tx DMA transfer provides the remainder of the DMA data.Generally, the result may be written to memory, or more generally to thehost address space (e.g. as transformed DMA data, appended to the DMAdata, or to a separate result memory location such as a field in the DMAdescriptor for the Tx DMA transfer).

The loopback circuit 40 may also include FIFOs for the offload engine 44and the XOR circuit 46 (offload FIFO 48 coupled to the offload engine 44and XOR FIFO 50 coupled to the XOR circuit 46). The FIFOs 48 and 50 maytemporarily store data from the offload engine 44 and the XOR circuit46, respectively, until the DMA data may be transmitted on the receiveDMA data path. An arbiter 52 is provided in the illustrated embodiment,coupled to the FIFOs 42, 48, and 50, to arbitrate between the FIFOs. Thearbiter 52 is also coupled to a loopback FIFO 54, which may temporarilystore data from the loopback circuit 40 to be written to the target.

The Tx control circuit 56 transmits DMA data to the target. The target,in this embodiment, may be either one of the interface circuits 16 orthe loopback circuit 40 (and more particularly, one of the copy FIFO 42,the offload engine 44, and the XOR circuit 46 in the illustratedembodiment). The Tx control circuit 56 may identify the target fortransmitted data (e.g. by transmitting a target identifier).Alternatively, physically separate paths may be provided between the Txcontrol circuit 56 and the interface circuits 16 and between the Txcontrol circuit 56 and loopback components 42, 44, and 46. The Txcontrol circuit 56 may include a set of buffers 62 to temporarily storedata to be transmitted. The Tx control circuit 56 may also providevarious control information with the data. The control information mayinclude information from the DMA descriptor. The control information mayinclude, for the loopback circuit 40, the buffer pointer (or pointers)for storing data in the target address space. The control informationmay also include any other control information that may be included inthe DMA descriptor and may be used by the interface circuits 16 or theloopback circuit 14. Examples will be provided in more detail below withrespect to the DMA descriptor discussion.

The Rx control circuit 58 may receive DMA data to be written to the host12 address space, and may generate writes to store the data to memory.In one embodiment, software may allocate buffers in memory to storereceived DMA data. The Rx control circuit 58 may be provided with bufferpointers (addresses in the host address space identifying the buffers).The Rx control circuit 58 may use the buffer pointer to generate theaddresses for the writes to store the data. An Rx prefetch engine 60 maybe provided to prefetch the buffer pointers for the Rx control circuit58. The Rx prefetch engine 60 is coupled to provide the buffer pointersto the Rx control circuit 58. The Rx prefetch engine 60 may include aset of buffers 64 to temporarily store prefetched buffer pointers foruse by the Rx prefetch engine 60. Similarly, the Rx control circuit 58may include a set of buffers 68 to temporarily store received DMA datato be written to memory.

In one embodiment, the Rx control circuit 58 may be configured togenerate descriptors for received DMA data. That is, rather than havingsoftware create DMA descriptors for received DMA data, software mayallocate buffers to store the DMA data and may provide the bufferpointers. The Rx control circuit 58 may store received DMA data in theallocated buffers, and may create the descriptors for the DMA transfers.The descriptors created by the Rx control circuit 58 may include one ormore buffer pointers to one or more buffers storing the received DMAdata, as well as other information describing the DMA transfer. Sincethe Rx control circuit 58 creates the descriptors for received DMA data,the descriptors may be more efficient than those created by software.For example, software may have to create receive DMA descriptors capableof receiving the largest possible DMA transfer (or multiple descriptorsmay be required for larger transfers), and may have to allocate enoughbuffers for storing the largest possible DMA transfer. On the otherhand, descriptors created by the Rx control circuit 58 may be largeenough for the actual transfer received (and may consume enough buffersto store the received data), but not necessarily larger.

In the illustrated embodiment, the Rx control circuit 58 may receive theDMA data from an arbiter 66, which is coupled to the loopback FIFO 54and to receive DMA data from the interface circuits 16 as well. Thearbiter 66 may arbitrate between the loopback FIFO 54 and the receivedDMA data from the interface circuits 16 to transfer data to the Rxcontrol circuit 58.

The arbiters 52 and 66 may implement any desired arbitration scheme. Forexample, a priority-based scheme, a round-robin scheme, a weightedround-robin scheme, or combinations of such schemes may be used. In someembodiments, the arbitration scheme may be programmable. The arbitrationscheme(s) implemented by the arbiter 52 may differ from the scheme(s)implemented by the arbiter 66.

The Tx control circuit 56, the Rx prefetch engine 60, and the Rx controlcircuit 58 are coupled to an IOM/IOB interface unit 70 in theillustrated embodiment. The IOM/IOB interface unit 56 may communicatewith the IOB 22 and the IOM 24 on behalf of the Tx control circuit 56,the Rx prefetch engine 60, and the Rx control circuit 58. The IOM/IOBinterface unit 70 may receive read and write requests from the Txcontrol circuit 56, the Rx prefetch engine 60, and the Rx controlcircuit 58 and may communicate with the IOB 22 and the IOM 24 to satisfythose requests.

Particularly, the IOM/IOB interface unit 70 may receive read requestsfor descriptors and for DMA data from the Tx control circuit 56 and readrequests to the memory storing buffer pointers from the Rx prefetchengine 60, and may convey the requests to the IOB 22. The IOB 22 mayindicate which IOM 24 entry stores a cache line of data including therequested data (subsequent to reading the data from the host addressspace or the IOC 26, for example, or the data may already be in the IOM24 from a previous request), and the IOM/IOB interface 70 may read thedata from the IOM 24 and provide it to the Tx control circuit 56 or theRx prefetch engine 60. The IOM/IOB interface unit 70 may also receivewrite requests from the Rx control circuit 58, and may store the writedata in the IOM 24 (at an entry allocated for the write data by the IOB22). Once a cache line of data is accumulated in the IOM 24 (or the DMAtransfer completes, whichever comes first), the IOM/IOB interface unit70 may inform the IOB 22 and may provide an address to which the cacheline is to be written (derived from the buffer pointer to the bufferbeing written).

It is noted that, while the Tx control circuit 56 implements prefetch toobtain descriptors and DMA data, other embodiments may not implementprefetch. Thus, in general, there may be a Tx engine 56 or Tx controlcircuit 56 configured to perform transmit DMA transfers (and DMAtransfers to the loopback circuit 40).

It is noted that, while the data flow control circuit 70 is shownseparate from the Tx control circuit 56 in FIG. 2 for ease ofillustration, it may be the case in practice that the circuitryimplementing the data flow control circuit 70 and the circuitryimplementing the Tx control circuit 56 may be intermingled. That is, theillustration of FIG. 2 is not necessarily meant to indicate physicalseparation of circuitry. Other illustrations herein may be similar.

It is noted that the present description refers to buffers and bufferpointers for DMA transfers. A buffer that is pointed to by a bufferpointer (as opposed to hardware storage buffers such as 62, 64, and 68)may comprise a contiguous memory region. Software may allocate thememory region to store DMA data (either for transmission or as a regionto receive DMA data). The buffer pointer may comprise an address of thememory region in the host address space. For example, the buffer pointermay point to the base of the memory region or the limit of the memoryregion.

Turning now to FIG. 3, a block diagram of one embodiment of the offloadengine 44 is shown. In the illustrated embodiment, the offload engine 44includes an input buffer 80, an output buffer 82, a set of securitycircuits 84A-84D, a CRC generator 86, and a checksum generator 88. Theinput buffer 80 is coupled to the Tx control circuit 56 and to thesecurity circuits 84A-84D, the CRC generator 86, and the checksumgenerator 88. The output buffer 82 is coupled to the security circuits84A-84D, the CRC generator 86, and the checksum generator 88. The outputbuffer 82 is coupled to the offload FIFO 48 as well. The securitycircuit 84A is shown in greater detail in FIG. 3 for one embodiment, andthe security circuits 84B-84D may be similar. The security circuit 84Aincludes a hash circuit 90 and a cipher circuit 92. The hash circuit 90and the cipher circuit 92 are both coupled to the input buffer 80 andthe output buffer 82. Additionally, the output of the hash circuit 90 iscoupled as an input to the cipher circuit 92 and the output of thecipher circuit 92 is coupled as an input to the hash circuit 90 in a“butterfly” configuration.

The security circuits 84A-84D may be configured to perform variousoperations to offload security functions of packet processing.Particularly, the security circuits 84A-84D may be configured to performencryption/decryption (collectively referred to as ciphering, or cipherfunctions) and hashing functions that are included in various securepacket specifications (e.g. the secure internet protocol (IPSec) orsecure sockets layer (SSL)).

Typically, communicating using a secure packet protocol includes anegotiation session in which the endpoints communicate the protocolsthat they can use, the security schemes that the support, type ofencryption and hash, exchange of keys or certificates, etc. Then thereis a bulk transfer phase using the agreed-upon protocols, encryption,etc. During the bulk transfer, packets may be received into the host 12(e.g. via the receive DMA path from one of the interface circuits 16).Software may consult data structures in memory to obtain the keys,encryption algorithms, etc., and prepare a DMA transfer through theoffload engine 44 to decrypt and/or authenticate the packet. Similarly,software may prepare a packet for secure transmission and use a DMAtransfer through the offload engine 44 to encrypt and/or authenticatethe packet.

The hash circuit 90 may implement various hash functions that may beused in authentication of packets. Typically, the hash is computed overat least a portion of the packet, and the hash result is included in thepacket. When the packet is received at its destination, the hash may bechecked to detect if any fields in the packet have been changed (andthus detect if the packet was modified in transit from its source). Inone embodiment, the following hash functions may be supported in thehash circuit 90: Message Digest 5 (MD-5)/secure hash algorithm-1(SHA-1), and hashed message authentication code (HMAC). Otherembodiments may implement SHA-2. Other embodiments may implement anyother set of hash functions, including subsets or supersets of the abovefunctions and other functions.

The cipher circuit 92 may be configured to perform cipher functions.Depending on the secure packet specification, the cipher function may beapplied to at least a portion of the packet, possibly including the hashdata. Any set of cipher functions may be supported in variousembodiments. For example, in one embodiment, the followingencryption/decryption algorithms may be implemented in the ciphercircuit 92: data encryption standard (DES), triple data encryptionstandard (3DES), advanced encryption standard (AES), Kasumi, allegedRon's code 4 (ARC4) and/or Ron's code 4 (RC4).

In some cases, if both authentication and cipher functions are beingused, the encryption is performed first when preparing a packet fortransmission, and then authentication hashing is performed over theencrypted data (e.g. IPSec). In other cases, the authentication hash isperformed first, and encryption of the packet (including the hash data)is performed second (e.g. SSL). In either case, the authentication hashand decryption are performed in the opposite order on a received packet.

The security circuits 84A-84D may support either order of ciphering andhashing of data in a single DMA transfer, via the butterfly connectionbetween the circuits 90 and 92. That is, if ciphering is to be performedfirst, the data provided to the security circuit 84A may be routed tothe cipher circuit 92, and the output of the cipher circuit 92 may berouted to the input of the hash circuit 90 to compute the hash functionon the encrypted (or decrypted) data. If hashing is to be performedfirst, the data provided to the security circuit 84A may be routed tothe hash circuit 90, and the output of the hash circuit 90 may be routedto the input of the cipher circuit 92. The security circuits 84A-84Dalso support performing only the hash or only the cipher function in agiven DMA transfer. Control information from the DMA descriptor for theDMA transfer directed to the security circuits 84A-84D may control therouting of data through the security circuits 84A-84D.

The illustrated embodiment shows 4 security circuits 84A-84D. Otherembodiments may include any number of security circuits, including onesecurity circuit. In one embodiment, the security circuits 84A-84D maybe clocked at double the frequency of the system clock used in thesystem 10 and may receive two operations per system clock cycle (oneperformed in the first half of the system clock cycle and the other inthe second half of the system clock cycle). Thus, there may be 8 logicalsecurity circuits that may be selected by software to perform securityfunctions.

The CRC generator 86 may be configured to generate CRC data over thedata provided in a DMA transfer specifying CRC generation. The CRCgeneration may also be used to check CRC data from a received packet.For example, the CRC data generated in the CRC generator 86 may becompared to the corresponding CRC data in the received packet.Alternatively, the CRC data in the received packet may be included inthe DMA transfer through the CRC generator 86, and the result may bechecked against a predetermined value to detect error in the receivedpacket. In some embodiments, there may be more than one CRC generator86. Furthermore, the CRC generator(s) 86 may be clocked at twice thesystem clock frequency, similar to the security circuits 84A-84D, toprovide more logical CRC generators than are physically provided in theoffload engine 44. In one particular embodiment, there may be 4 of theCRC generators 86, clocked at twice the system clock frequency, toprovide an equal number of logical units (8) to the security circuits84A-84D.

The checksum generator 88 may be configured to generate a checksum overthe data provided in a DMA transfer that specifies checksum generation.The checksum generation may also be used to check the checksum data froma received packet. For example, the checksum data generated in thechecksum generator 88 may be compared to the corresponding checksum inthe received packet. Alternatively, the checksum data in the receivedpacket may be included in the DMA transfer through the checksumgenerator 88, and the result may be checked against a predeterminedvalue to detect error in the received packet. In some embodiments, theremay be more than one checksum generator 88.

The input buffer 80 may temporarily store data provided by the Txcontrol circuit 56 until the target circuit 84A-84D, 86, or 88 mayoperate upon the data. The circuits 84A-84D, 86, and 88 may output datato the output buffer 82 to be written to the offload FIFO 48. In otherembodiments, the input buffer 80 and/or the output buffer 82 may not beincluded.

Turning next to FIG. 4, a block diagram of a memory region 110 storingdescriptor data structures and buffer pointer data structures is shown.In the embodiment of FIG. 4, the descriptor data structures include aset of descriptor rings 112A-112N. There may be one descriptor ring foreach DMA channel supported by the DMA controller 14 (e.g. channel 0 tochannel N in FIG. 4). That is, there may be a one-to-one correspondencebetween DMA channels and descriptor rings, and the DMA transfers for agiven DMA channel may have corresponding descriptors in the descriptorring 112A-112N assigned to that channel. If a DMA channel is disabled orotherwise not in use, there may not be a descriptor ring for the channeluntil the channel is enabled/used. Additionally, in the embodiment ofFIG. 4, the buffer pointer data structures may including a set of bufferpointer rings 114A-114M. There may be a buffer pointer ring perinterface circuit 16 (e.g. interface circuits 0 to M in FIG. 4, whereM+1 may be the number of interface circuits 16). That is, there may be aone-to-one correspondence between interface circuits and descriptorrings, and the buffer pointers used for DMA's received on that interfacemay be taken from the buffer pointer ring 114A-114M assigned to thatinterface circuit. In an interface is disabled or otherwise not in use,there may not be a buffer pointer ring for that interface at that time.

Each descriptor ring 112A-112N may comprise a set of descriptors for thecorresponding DMA channel. For transmit DMA channels, the descriptorsmay be processed in the order included within the ring, from the firstdescriptor in the ring to the last, and then wrapping around to thefirst descriptor in the ring after the last descriptor has beenprocessed. Thus, at a given point in time, any descriptor in the ringmay be viewed as the “current descriptor” that is the next to beprocessed. Software may control the number of descriptors that areavailable for processing on the DMA channel in a variety of fashions, asmentioned above. Accordingly, if there are descriptors available on agiven transmit DMA channel (in the corresponding descriptor ring), theDMA controller 14 may perform the specified DMA transfers (arbitratingfor resources with other DMA channels). For receive DMA channels in thepresent embodiment, the descriptors in the corresponding descriptor ringmay be consumed as DMA transfers are received on that channel. The DMAcontroller 14 may write the current descriptor with the bufferpointer(s) used to store the received DMA data, as well as otherinformation related to the DMA transfer such as transfer statusinformation.

Other embodiments may use other data structures (e.g. linked lists ofdescriptors). The base address of each descriptor ring 112A-112N may beprovided to the DMA controller 14. Other attributes of the descriptorring 112A-112N may be programmed as well (e.g. extent). In someembodiments, the descriptors in a given ring may be of a fixed size, sothat a given descriptor may be at a fixed offset from the base addressof the ring. In other embodiments, descriptors may be variable in size,or programmably selected as fixed or variable (e.g. on a channel bychannel basis). While the processing of descriptors in a given ring maygenerally be attempted in order, various implementations may prefetchfrom the ring and/or the DMA memory buffers, overlap processing ofdescriptors, and/or process two or more descriptors in parallel.

Each buffer pointer ring 114A-114M comprises buffer pointers pointing tobuffers in memory allocated by software for use to store DMA data fromRx DMA transfers from the corresponding interface. Similar to thedescriptor rings 112A-112N, software may make the buffer pointers in thebuffer pointer rings 114A-114M available to the DMA controller 14 in anydesired fashion. The base address of the buffer pointer ring for eachinterface may be programmed into the DMA controller 14, and at any giventime, one of the buffer pointers in the buffer pointer ring may be thenext to be consumed for the corresponding interface.

By providing the buffer pointer rings 114A-114M associated with theinterface circuits, rather than the DMA channels, the software mayallocate buffers to the smaller number of interface circuits rather thanthe larger number of DMA channels, in some embodiments. The allocationof memory may, in some cases, be more efficient. Interface circuits thatare handling more traffic may be allocated more buffers, withoutsoftware having prior knowledge of what channels that traffic will bereceived on. As DMA data is received from a given interface, the datamay be stored in the buffers allocated to that interface and the bufferpointers may be written to the descriptor for the channel on which theDMA data is received. The descriptor may be in one of the descriptorrings 112A-112N, depending upon which receive DMA channel is associatedwith the DMA transfer.

The buffer pointer rings 114A-114M may also include a size field (Sz inFIG. 4) for each buffer pointer. The size field may indicate the size ofthe buffer pointed at by the corresponding buffer pointer. Accordingly,software may allocate buffers of different sizes based on, e.g., theamount of memory available, the expected size of DMA transfers on agiven interface, etc.

Turning next to FIG. 5, a flowchart is shown illustrating operation ofone embodiment of the Tx control circuit 56 and the data flow controlcircuit 70 for a given Tx DMA channel. The Tx control circuit 56 and/orthe data flow control circuit 70 may include circuitry that implementsthe operation shown in FIG. 5 for each Tx DMA channel, operating inparallel and independently. While blocks are shown in a particular orderin FIG. 5 for ease of understanding, the blocks may be implemented inparallel in combinatorial logic circuitry that implements the operationshown in FIG. 5. In some embodiments, one or more of the blocks or theflowchart as a whole may be pipelined over multiple clock cycles.

The Tx control circuit 56 may determine if descriptors are available forthe channel for prefetch (in the descriptor ring 112A-112N correspondingto the channel) (decision block 150), and if descriptors are needed forthe channel (decision block 152). If at least one descriptor isavailable and needed (decision blocks 150 and 152, “yes” leg), the Txcontrol circuit 56 may generate a request to read the descriptors fromthe descriptor ring 112A-112N in the host 12's memory (block 154). It isnoted that, if descriptors are prefetched and a previous descriptorincludes the serialize indication indicating serialization or is acontrol descriptor indicating a wait on a flag, the prefetches may bediscarded and prefetching may be inhibited until the Tx control circuit56 is released for that channel.

Descriptors may generally be “available” if there are descriptors in thecorresponding descriptor ring 112A-112N that have not been prefetched bythe Tx control circuit 56. The descriptors for a Tx DMA channel may beinserted into the descriptor ring 112A-112N by software, and softwaremay indicate that they are available in any of the previously mentionedfashions (e.g. using valid bits in the descriptor ring entries,incrementing a descriptor ring count, etc.). Descriptors may be viewedas “needed” in a variety of fashions as well. For example, if a Tx DMAchannel is enabled, there are no descriptors prefetched for the channel,and the channel is not stalled awaiting a serialization or flag value, adescriptor may be “needed”. In some embodiments, the Tx control circuit56 may prefetch descriptors as along as there is room in the IOM 24and/or the buffers 62 to store the descriptors. In other embodiments,the Tx control circuit 56 may be programmable to indicate a number ofdescriptors that should be prefetched, or a minimum and maximum numberof descriptors that should be prefetched. The Tx control circuit 56 maygenerate prefetch requests for descriptors to attempt to prefetch theprogrammed number of descriptors.

The Tx control circuit 56 may be informed by the IOM/IOB interfacecircuit 70 when prefetched descriptors are available in the IOM 24 to beread. The Tx control circuit 56 may, in some embodiments, read some orall of the descriptors from the IOM 24 into the buffers 62.

The Tx control circuit 56 may process the current descriptor for thechannel (block 155). Processing the current descriptor may includinghandling control descriptors to write a flag or wait on a flag value, aswell as handling the serialization within the channel. For example, FIG.6 is a flowchart illustrating block 155 in more detail. The Tx controlcircuit 56 and/or the data flow control circuit 70 may include circuitrythat implements the operation shown in FIG. 6 for each Tx DMA channel,operating in parallel and independently. While blocks are shown in aparticular order in FIG. 6 for ease of understanding, the blocks may beimplemented in parallel in combinatorial logic circuitry that implementsthe operation shown in FIG. 6. In some embodiments, one or more of theblocks or the flowchart as a whole may be pipelined over multiple clockcycles.

In FIG. 6, if the current descriptor includes a serialization indicationand the done indication from the Rx control circuit 58 has not yet beenreceived for the channel (decision block 162, “yes” leg), the Tx controlcircuit 56 may wait for a release from the data flow control circuit 70(in response to the done indication) (block 164). If the descriptor is acontrol descriptor specifying a wait for a value in a flag and the valuehas not been found yet (decision block 164, “yes” leg), the Tx controlcircuit 56 may communicate the wait to the data flow control circuit 70and wait for a release from the data flow control circuit 70 (inresponse to the flag having the specified value) (block 168). If thedescriptor is a control descriptor specifying a flag update (decisionblock 170, “yes” leg), the Tx control circuit 56 may transmit the updateto the data flow control circuit, which may update the flag (block 172).

Returning to FIG. 5, the Tx control circuit 56 may determine if DMA datais available for the channel for prefetch (to be transmitted on thechannel) (decision block 156), and if DMA data is needed for the channel(decision block 158). If DMA data is available and needed (decisionblocks 156 and 158, “yes” leg), the Tx control circuit 56 may generate arequest to read the DMA data from the host 12's address space (e.g. frommemory locations in the host 12) (block 160).

DMA data may be regarded as available for prefetch if the Tx controlcircuit 56 has a descriptor to be processed (e.g. the descriptor is thenext one to be processed from the descriptor ring for the channel), thedescriptor data is in the buffers 62 or the IOM 24, and the descriptordata describes a valid DMA transfer to be performed. DMA data may beneeded if previous DMA data on the channel has been transmitted (or willbe transmitted soon). In some embodiments, the Tx control circuit 56 maybe programmable with how much DMA data is to be prefetched at any giventime, and DMA data may be needed if less than the desired amount of DMAdata has been prefetched and not yet transmitted. In some embodiments,the arbitration scheme among the transmit channels may also affect ifDMA data is needed (e.g. if the channel will not win arbitration for arelatively large amount of time, DMA data may not yet be needed since itmay not be transmitted until it wins arbitration).

It is noted that the operation illustrated by blocks 156, 158, and 160may be independent of the operation of blocks 150, 152, and 154 (otherthan that the prefetched descriptors are used to determine if DMA datais available). Accordingly, circuitry that implements blocks 156, 158,and 160 may be independent of the circuitry that implements blocks 150,152, and 154 and may evaluate in parallel with such circuitry.

As mentioned above, the operation of FIG. 5 may be performed in parallelfor each enabled Tx DMA channel. If more than one prefetch request isgenerated concurrently, the Tx control circuit 56 may also includecircuitry to select among the prefetch requests. For example, the Txcontrol circuit 56 may select the prefetch request corresponding to TxDMA channel for which the fewest descriptors or smallest amount of DMAdata are currently prefetched and ready. As another example, the Txcontrol circuit 56 may weight the requests based on which Tx DMA channelhas the largest difference between the currently prefetcheddescriptors/DMA data and the desired number of descriptors/amount of DMAdata for that channel. Round-robin or priority based selectionmechanisms may also be used, and these schemes may include programmableweighting among the channels, if desired. Starvation preventionmechanisms such as per-channel timeouts may also be used to ensure thatdescriptors and DMA data are prefetched for each enabled channel.

The Tx control circuit 56 may be informed by the IOM/IOB interfacecircuit 70 when prefetched DMA data is available in the IOM 24 to beread. The Tx control circuit 56 may, in some embodiments, read some orall of the DMA data from the IOM 24 into the buffers 62. Additionally,the Tx control circuit 56 may transmit the prefetched DMA data to thetarget.

FIGS. 7-10 illustrate examples of descriptors of various types accordingto one embodiment of the DMA controller 14. Generally, the descriptorscomprise a header, optionally a data field to store a result (e.g. aresult generated by the loopback circuit 40), and one or more bufferpointers that point to buffers storing DMA data (source buffer pointers)or to buffers that may be used to store DMA data (destination bufferpointers).

In the present embodiment, descriptors vary based on whether they arereceive or transmit DMAs, or the function to be performed by theloopback circuit 40, if selected. Receive descriptors are used for RxDMA transfers, and other types of descriptors are used by the Tx DMAtransfers and loopback functions. The DMA controller 14 (and moreparticularly the Tx control circuit 56, in one embodiment) may determinethe format of the descriptors in a descriptor ring for a given Tx DMAchannel based on the assignment of that channel to the interfacecircuits 16 or to a function in the loopback circuit 40.

In FIGS. 7-10, various fields are illustrated in detail (e.g. the headerfield in particular). While certain information is shown in FIGS. 7-10,it is not intended to preclude the use of other information in additionto that illustrated, or in addition to a subset of that illustrated, oras an alternative to that illustrated. Various additional informationmay be included, in various implementations, as desired.

FIG. 7 is a block diagram of one embodiment of a transmit descriptor200. The transmit descriptor 200 may be the format of descriptors usedby the Tx control circuit 56 for Tx DMA transfers to interface circuits16, particularly to MACs 34A-34B, and may be written by software to thedescriptor rings 112A-112N that correspond to Tx DMA channels assignedto the interface circuits 16. In the embodiment of FIG. 7, the transmitdescriptor 200 includes a header field 202 (illustrated in exploded viewin FIG. 7 for one embodiment) and one or more buffer pointer fields204A-204N. Each buffer pointer field 204A-204N includes a size fieldthat may be encoded with the size of the buffer and a pointer fieldencoded with the pointer to the buffer. The Tx control circuit 56 may beconfigured to read the buffer pointer fields 204A-204N to prefetch theDMA data from the buffers for transmission.

The exploded view of the transmit header field 202 includes a type field202A, a style field 202B, a MAC configuration field 202C, a packetlength field 202D, and a packet info field 202E. The type field 202A mayencode the descriptor type, e.g. control descriptor or transferdescriptor. The type field 202A (and other similar type fields describedbelow for other descriptors) may identify the descriptor as a transferdescriptor except for the control descriptor shown in FIG. 8. The stylefield 202B may encode the style of the descriptor, which refers towhether the buffer pointers in the buffer pointer fields 204A-204Ninclude both source and destination pointers or only source pointers.The MAC configuration field 202C may be encoded with variouspacket-specific MAC configuration information for the MAC 34A-34B thatis targeted by the DMA transfer. For example, the MAC configurationfield 202C may include virtual local area network (VLAN) configuration(e.g. none, insert, remove, or modify), CRC configuration (e.g. none,insert CRC, pad CRC, modify CRC), and whether to modify the MAC sourceaddress. The packet length field 202D may be encoded with the length ofthe packet stored in the buffers (e.g. in bytes). The packet info field202E may be encoded with various information describing the packet (e.g.IP header length, Ethernet header length, type of packet (TCP/UDP),checksum enable, etc.).

In this embodiment, the transmit descriptor 200 does not include aserialize indication to permit serialization. Other embodiments mayinclude the serialize indication. In the case of serialization of thetransmit descriptor 200, the DMA transfer may be considered completewhen the last DMA data of the transfer are transmitted to thedestination interface circuit.

FIG. 8 is a block diagram of one embodiment of a control descriptor 206.The control descriptor 206 may be the format of control descriptors usedby the Tx control circuit 56 in any DMA channel. Specifically, thecontrol descriptor 206 may be used for the flag wait and flag updatedescriptors for the flags in the flags register 72. In the embodiment ofFIG. 8, the control descriptor 230 includes a header field 207(illustrated in exploded view in FIG. 8 for one embodiment) with no datafield.

The exploded view of the control header field 207 includes a type field208A, a flag number field 208B, and an event type field 208C. The typefield 208A may be similar to the type field 202A described above,identifying the descriptor 206 as a control descriptor. The flag numberfield 208B may specify which flag to update (that is, the position ofthe flag within the flags register 72). The event type field 208C mayindication which type of control descriptor is being provided. Theencodings of the event type field 208C may include wait for flag=0; waitfor flag=1; write flag to 0; and write flag to 1. For each of thoseencodings, the flag is the one specified in the flag number field 208B.In one embodiment, the event type field 208C may also include a “waitfor external” encoding. The wait for external encoding may wait for anexternal signal to be asserted before releasing the Tx control circuit56 for the channel.

In embodiments in which a flag is a multibit value, the event type fieldmay list the value that is being waited on or written, or each possiblevalue my be encoded.

FIG. 9 is a block diagram of one embodiment of a copy descriptor 210.The copy descriptor 210 may be the format of descriptors used by the Txcontrol circuit 56 for copy DMA transfers (from one memory region in thehost 12 to another memory region in the host 12) using the copy FIFO 42.Thus, the copy descriptor 210 may be used in the descriptor rings112A-112N that correspond to Tx DMA channels assigned to the copy FIFO42. In the embodiment of FIG. 9, the copy descriptor 210 includes aheader field 212 (illustrated in exploded view in FIG. 9 for oneembodiment) and one or more buffer pointer fields 214A-214N. Each bufferpointer field 214A-214N includes a size field that may be encoded withthe size of the buffer and a pointer field encoded with the pointer tothe buffer. Additionally, in this embodiment, each buffer pointer field214A-214N includes a source/destination (S/D) field identifying thepointer as either a source pointer (locating a buffer storing source DMAdata) or a destination pointer (locating a buffer to which the DMA datais to be stored). The Tx control circuit 56 may be configured to readthe buffer pointer fields 214A-214N to prefetch the DMA data from thesource buffers for transmission and to provide the destination pointersto the copy FIFO 42 for transmission to the Rx control circuit 58.

In one embodiment, there may be more than one source pointer for a givendestination pointer in the copy descriptor 210. The DMA controller 14may copy data from the source buffers in the order listed in the copydescriptor 210 into the destination buffer. Thus, the DMA controller 14may support gathering of scattered data from multiple memory regionsinto a destination memory region in the copy operation. Similarly, inone embodiment, there may be more than one destination pointer for agiven source pointer in the copy descriptor 210. In such embodiments,scatter of the data from the source buffer may be supported.

The exploded view of the transmit header field 212 includes a type field212A, a style field 212B, a source type field 212C, a destination typefield 212D, a logical block length field 212E, and an additional field212F. The type field 212A and style field 212B may be similar to thetype field 202A and style field 202B described above. The source typefield 212C and the destination type field 212D may be encoded toindicate how the source buffer pointer(s) and destination bufferpointer(s) should be modified as the DMA transfer progresses. Forexample, each buffer pointer may be one of the following types, in oneembodiment: sequential increment; sequential decrement; or fixed (withvarious fixed widths, e.g. 1, 2, 4, 8, or 16 bytes). Sequentialincrement indicates that the address is incremented after each datatransmission by the amount of data transmitted. Sequential decrement issimilar, but the address is decremented. Sequential increment orsequential decrement may be used for memory regions, where the data iswritten to sequential memory locations. The fixed option may be used ifan address is memory mapped to a register or port of a device, and thewidth may be the width of each transmission to the register/device. Thesource type field 212C may also have an encoding for zero, and may beused to write a block of zeros to the destination. The destination typefield 212D may also have an encoding for prefetch only, in which thesource DMA data is prefetched but not written to a destination. Thelogical block length field may be used, in some embodiments, to indicatethe length of a logical DMA block that may span multiple DMAdescriptors. That is, the logical DMA operation may actually bespecified using multiple descriptors, and the logical DMA block lengthmay be the length of the logical DMA operation (e.g. the sum total ofdata transfer over the multiple descriptors).

The additional field 212F includes a few additional control fields,including a serialize indication. The serialize indication may comprisea bit, for example, with the set state requesting serialization and theclear state not requesting serialization (or vice versa). Otherembodiments may use a multibit serialize indication having variousencodings, if desired.

The XOR circuit 46 may use descriptors that are similar to the transmitDMA descriptor 200. Multiple channels may be assigned to the XOR circuit46, and descriptors in each of the channels may specify one of the XORsources. The first channel may also specify the destination for the XORresult (a destination buffer or buffers).

FIG. 10 is a block diagram of one embodiment of an offload descriptor220. The offload descriptor 220 may be the format of descriptors used bythe Tx control circuit 56 for DMA transfers that specify the offloadengine 44. Thus, the offload descriptor 220 may be used in thedescriptor rings 112A-112N that correspond to Tx DMA channels assignedto the offload engine 44. In the embodiment of FIG. 10, the offloaddescriptor 220 includes a header field 222 (illustrated in exploded viewin FIG. 10 for one embodiment), an optional result reserve field 224,and one or more buffer pointer fields 226A-226N. Each buffer pointerfield 226A-226N includes a size field that may be encoded with the sizeof the buffer and a pointer field encoded with the pointer to thebuffer. Additionally, in this embodiment, each buffer pointer field226A-226N includes a source/destination (S/D) field identifying thepointer as either a source pointer (locating a buffer storing source DMAdata) or a destination pointer (locating a buffer to which the DMA datais to be stored). The Tx control circuit 56 may be configured to readthe buffer pointer fields 226A-226N to prefetch the DMA data from thesource buffers and to identify destination buffers, if any. Iftransformed DMA data is the result of the offload engine 44, there maybe destination pointers for the transformed DMA data. If a resultseparate from the DMA data is generated (e.g. for storage in the resultreserve field 224), there may be no destination pointers in some casesand the DMA data may not be written to a destination.

The exploded view of the offload header field 222 includes a type field222A, a style field 222B, a result reserve field 222C, a crypto modefield 222D, a function number field 222E, a logical block length field222F, an offload control field 222G, and an additional field 222H. Thetype field 222A and style field 222B may be similar to the type field202A and style field 202B described above, and the logical block lengthfield 222F may be similar to the logical block length field 212Edescribed above. The result reserve field 222C may be encoded toindicate whether or not the result reserve field 224 is included in theoffload header descriptor 220, and may also indicate the size of theresult reserve field 224 (e.g. 64 bit, 192 bit, or 320 bit, in oneembodiment). The result reserve field 224 may be used to store theresult generated by the offload engine 44, if the result is nottransformed DMA data or is generated in addition to transformed DMAdata. The crypto mode field 222D may be encoded with the desired modefor the offload engine 44 to process the data, if any. The crypto modemay include none, signature only (e.g. CRC or checksum in the generators86 or 88), encryption only, decryption only, encryption and hash (withoptions for hash first or encryption first), or decryption and hash(with options for hash first or decryption first). The function numberfield 222E may be encoded with the function number for those modes thatuse the security circuits 84A-84D (e.g. one of eight logical functionsformed from the security circuits 84A-84D, as mentioned above). Theoffload control field 222G may include additional control informationfor the DMA transfer. For example, the length of each of the signatureheader, the cipher header, cipher trailer, and the hash size may beincluded in the offload control field 222G. Similarly, the selectedencryption/decryption (cipher) algorithm, hash algorithm, and blockcipher mode may be encoded in the offload control field 222G. Variousother control bits may be included in the offload control field 222G aswell. The additional field 222H may include various other controlfields, including the serialize indication similar to the additionalfield 212F.

Turning now to FIG. 11, an example of the use of the flags 72 to controldata flow between channels to support TCP/IP processing to send a packetis shown. A table 230 is shown in FIG. 11, illustrating various layersof processing in the TCP/IP stack and DMA functions that can be used tooffload some of the processing at those layers. The illustrate layersinclude the TCP layer, the IP/IPSec layer, and the network layer. Forthis example, the TCP layer uses DMA channel 1, the IP/IPSec layer usesDMA channel 2, and the network layer uses DMA channel 3. Any set ofchannels may be used.

At the TCP layer, a packet from the application layers above (not shownin FIG. 11) may be received. The TCP header may be used to encapsulatethe packet (e.g. generated by software executing on the processors18A-18B). The TCP header includes a checksum, which the DMA controller14 may be used to generate. The TCP packet is then passed to the IPlayer, which includes encryption of the TCP packet and adding a hash tothe end of the packet. These operations may be offloaded to the DMAcontroller 14. The IP/IPSec layer processing also includes adding theIPSec and IP headers to the packet, which may be performed by software.Finally, the network layer encapsulates the IP packet with an Ethernetheader (and CRC trailer). The DMA controller may be used to transmit thepacket and add the CRC, and the Ethernet header may be added bysoftware.

Using the data flow control descriptors, the above processing may beperformed for a packet or packets, and the DMA controller 14 mayautomatically process the packet through the layers. Specifically,software may build three buffers in memory (reference numerals 232, 234,and 236). The buffer 232 may store the TCP packet, with the TCP headergenerated by software. The buffer 232 may be the source buffer for afirst DMA transfer (DMA 1 in FIG. 11) in the channel 1 descriptor ring.The destination buffer for DMA 1 may be the buffer 234, which may alsobe the source buffer for a second DMA transfer (DMA 2 in FIG. 11) in thechannel 2 descriptor ring. Software may write the IPSec and IP headersto the buffer 234. The destination buffer for the second DMA transfermay be the buffer 236, which may also be the source buffer for a thirdDMA transfer (DMA 3 in FIG. 11) in the channel 3 descriptor ring.Software may write the Ethernet header to the buffer 236.

Accordingly, software may write a DMA descriptor 238 for DMA 1 thatrequests the offload engine 44 perform a checksum generation on the DMAdata in the source buffer 232 and write the result to the buffer 234.Software may also write a DMA descriptor 240 for DMA 2 in that requestshash and crypto services from the offload engine 44, and has the buffer234 as the source and the buffer 236 for the destination. Software maywrite a DMA descriptor 242 for DMA 3, requesting transmission and CRCgeneration. The source buffer for DMA 3 is buffer 236, and thedestination is the interface circuit coupled to the desired network.

To control the data flow between these tasks, software may assign flag 1to control the handoff from the TCP layer (channel 1) to the IP/IPSeclayer (channel 2), and may assign flag 2 to control the handoff from theIP/IPSec layer (channel 2) to the network layer (channel 3).Accordingly, a control descriptor 244 to write flag 1 is included in thedescriptor ring for channel 1 after the DMA descriptor 238 and a controldescriptor 246 to wait on flag 1 is included in the descriptor ring forchannel 2 prior the DMA descriptor 240. Additionally, a controldescriptor 248 to write flag 2 is included in the descriptor ring forchannel 2 after the DMA descriptor 240 and a control descriptor 250 towait on flag 2 is included in the descriptor ring for channel 3 priorthe DMA descriptor 242. In this fashion, the sequence of DMA transferscan be controlled without interference/extra processing by software.

In a similar fashion, processing of a received packet up the TCP/IPstack may be flow controlled using the flags. In such a case, thechannels may be performed in the reverse order of that shown in FIG. 11may be used, and the opposite operation may be performed (e.g.decryption instead of encryption). Channel 3 may update a flag that iswaited on by channel 2, which may update a flag that is waited on bychannel 1.

Another example in which the flags may be used is for streaming ofpackets that use the same security association, key, and initializationvector. The packet may be divided into blocks (e.g. for cipher blockchaining (CBC) mode), and XOR and encrypt operations may be performed onthe stream of blocks. The first block XORs the initialization vector andthe first block of data, and the result is encrypted. Each subsequentblock uses the previous encrypted block output as input to the XOR alongwith the next block of data. Accordingly, a series of dependencies onthe DMA data from a previous XOR/encrypt operation to the next isformed, and the flags may be used to control the data flow dependenciesso that the entire encryption of the packet may be coded as a series ofDMA transfers that can be performed automatically.

Numerous variations and modifications will become apparent to thoseskilled in the art once the above disclosure is fully appreciated. It isintended that the following claims be interpreted to embrace all suchvariations and modifications.

1. A direct memory access (DMA) controller comprising: a transmitcircuit configured to perform DMA transfers, each DMA transfer describedby a DMA descriptor stored in a data structure in memory, where there isa data structure for each DMA channel that is in use; and a data flowcontrol circuit coupled to the transmit circuit and configured tocontrol the transmit circuit's processing of DMA descriptors for eachDMA channel responsive to data flow control data in the DMA descriptorsin the corresponding data structure.
 2. The DMA controller as recited inclaim 1 wherein the DMA descriptors for DMA transfers in a transmit DMAchannel comprise a serialize indication that indicates whether or notthe DMA transfer described by the DMA descriptor is to be serializedwith a subsequent DMA transfer in the same DMA channel, and wherein thedata flow control unit is configured to delay the transmit circuit'sprocessing of the DMA descriptor for the subsequent DMA transfer if theserialize indication indicates serialization.
 3. The DMA controller asrecited in claim 2 further comprising a receive circuit configured towrite DMA data of a given DMA transfer to a memory that is the target ofthe given DMA transfer, wherein the receive circuit is coupled toprovide a done indication to the data flow control circuit, wherein thedone indication indicates that the DMA data is globally visible.
 4. TheDMA controller as recited in claim 3 wherein the DMA data is globallyvisible if write transactions for the DMA data have been coherentlyordered on a coherent interconnect to the memory.
 5. The DMA controlleras recited in claim 2 wherein the transmit circuit is configured totransmit DMA data of a given DMA transfer to an interface circuit thatis the target of the given DMA transfer, wherein the transmit circuitconsiders the given DMA transfer serialized when the last of the DMAdata is transmitted to the interface circuit.
 6. The DMA controller asrecited in claim 1 further comprising one or more registers coupled tothe data flow control circuit, wherein the one or more registers areconfigured to store a set of flags, and wherein the transmit circuit isconfigured to process control descriptors that update at least one flagand that wait for a given value of at least one flag.
 7. The DMAcontroller as recited in claim 6 wherein the control descriptoridentifies a position of the flag in the one or more registers andwhether an update or a wait is specified.
 8. The DMA controller asrecited in claim 7 wherein the control descriptor further identifies thegiven value to which the flag is being updated is being waited on. 9.The DMA controller as recited in claim 7 wherein, if the controldescriptor specifies the wait, the data flow control circuit isconfigured to delay processing in the DMA channel corresponding to thedata structure having the control descriptor until the given value isdetected for the flag.
 10. The DMA controller as recited in claim 6wherein each flag is a bit, and wherein the given value is either theset state or the clear state of the bit.
 11. The DMA controller asrecited in claim 6 wherein the one or more registers are softwarevisible, whereby software is able to at least read the set of flags fromthe one or more registers.
 12. The DMA controller as recited in claim 11wherein software is further able to write the set of flags in the one ormore registers.
 13. A method comprising: performing DMA transfers, eachDMA transfer described by a DMA descriptor stored in a data structure inmemory, where there is a data structure for each DMA channel that is inuse; and during the performing of the DMA transfers, controlling theprocessing of DMA descriptors for each DMA channel responsive to dataflow control data in the DMA descriptors in the corresponding datastructure.
 14. The method as recited in claim 13 wherein the DMAdescriptors for DMA transfers in a transmit DMA channel comprise aserialize indication that indicates whether or not the DMA transferdescribed by the DMA descriptor is to be serialized with a subsequentDMA transfer in the same DMA channel, and wherein the controlling theprocessing comprises delaying the processing of the DMA descriptor forthe subsequent DMA transfer if the serialize indication indicatesserialization.
 15. The method as recited in claim 14 wherein performingDMA transfers comprises writing DMA data of a given DMA transfer to amemory that is the target of the given DMA transfer, and the methodfurther comprising providing a done indication to indicate that the DMAdata is globally visible.
 16. The method as recited in claim 15 whereinthe DMA data is globally visible if write transactions for the DMA datahave been coherently ordered on a coherent interconnect to the memory.17. The method as recited in claim 13 further comprising processingcontrol descriptors that update at least one flag of a set of flags andthat wait for a given value of at least one flag of the set of flags 18.The method as recited in claim 17 wherein the control descriptoridentifies a position of the flag in the one or more registers andwhether an update or a wait is specified.
 19. The method as recited inclaim 18 wherein the control descriptor further identifies the givenvalue to which the flag is being updated or which is being waited on.20. The method as recited in claim 18 further comprising, if the controldescriptor specifies the wait, delaying processing in the DMA channelcorresponding to the data structure having the control descriptor untilthe given value is detected for the flag.
 21. The method as recited inclaim 17 wherein each flag is a bit, and wherein the given value iseither the set state or the clear state of the bit.
 22. An apparatuscomprising: a host comprising a memory system; and a direct memoryaccess (DMA) controller coupled to the host, wherein the DMA controlleris configured to perform DMA transfers, each DMA transfer described by aDMA descriptor stored in a data structure in the memory system, wherethere is a data structure for each DMA channel that is in use; andwherein the DMA controller is configured to control the processing ofDMA descriptors for each DMA channel responsive to data flow controldata in the DMA descriptors in the corresponding data structure.